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Major Activities 



The objectives for the project, "A Demonstration: Effecting 
Incremental improvements in K-12 Career Education," were ae 
follows . 

1. To determine how to install comprehensive career 
education programs on a districtwide basis when 
development and field testing have been completed. 

a. To demonstrate and document the process of 
districtwide installation of the Career 
Exploration Program and the Career Planning 
System in five Alliance school districts in 
which field testing has already taken place. 

b. To evaluate the effectiveness of the compre- 
hensive installation process employed by the 
school districts. 

2. To determine how to transport effective career 
education programs from school districts that 
have them to school districts that need them. 

a. To implement the Career Exploration Program 
and the Career Planning System and to evaluate 
their effectiveness with students and staff 

in four school districts not previously 
involved with the Alliance. 

b. To demonstrate and document the process 
involved in installing the programs in 
the four additional school districts. 

The objectives were met through the involvement of nine 

school districts in the Alliance for Career and 'vocational 

Education. The five "ongoing" school districts participating in 

the first objective were the Charleston (South Carolina) County 

Public Schools, Madison (Wisconsin) Metropolitan School District, 

Milwaukee (Wisconsin) Public Schools, Philadelphia (Pennsylvania) 
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Public Schools, and the Salinas (California) Union High School 
District, The four "new" school districts involved in the second 
objective were the Detroit (Michigan) Public Schools, Montgomery 
County (Maryland) Public Schools, New York City Board of Education, 
and Tucson (Arizona) Unified School District. 

In order to accomplish the objectives specified above, a 
number of activities took place. These activities are presented 
in Figure 1 in terms of the objectives that they accomplished. 

The objectives that were stated in the original proposal did 
not change during the course of the project. Progress related 
to learner outcomes and process objectives are presented under 
"Evaluation" in this report. 

Participant Summary 

Project participants are reported in "Table 1. Career 
Education Program Participant Summary." 
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FIGURE 1 
Summary of Project Activities 
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Career education directors and staff development 
coordinators received training at the National 
Center in August to prepare for program imple- 
mentation in their districts. 

Career education directors developed instal- 
lation plans indicating arrangements for staff 
development, program evaluation, and community 
involvement in 1978-79. 

The National Center printed and delivered one 
hundred eighty (180) classroom sets of career 
education curriculum materials for use by the 
students involved in the program. Appendix A 
contains a description of the career education 
programs used in the project. 

The district career education directors and 
staff development coordinators trained approxi- 
mately twenty teachers and counselors in each 
district to implement and field test the 
program. 

The Alliance programs were implemented in the 
nine school districts. 

Career education advisory committees were 
utilized in the districts to involve the 
community in the career education endeavor and 
to provide support to the school staff members 
involved in the project. 

School districts conducted conferences for LEA 
and SEA representatives in their areas in order 
to demonstrate the programs being implemented. 

Upon completion of program implementation, 
students in progrcun and equivalent control 
groups took posttests designed to measure the 
cognitive and affective impact attributable to 
the programs. Teachers and students completed 
instruments to show their appraisal of the 
programs they had experienced. 
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FIGURE 1 (continued) 
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National Center project staff conducted site 
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of the ongoing district? to gather data for 
the case study to be written on the topic of 

programs. School district administrators, 
career education directors and coordinators, 
and teachers were interviewed. 
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National Center project staff processed and 
analyzed the test data and other information 
received from the nine school districts. 
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TABLE 1 



DEPARTMENT OF HEALTH. EDUCATION, AND WELFARE 
OFFICE Of IDUCATIOH 
WASMINCON, D.C, 20202 

CARffR EDUCATION PROCRAM 

PARTICIPANT SUMMARY 



NOTE. P»rticif>Mnii inclu<it those DIRECTLY ••f»«d 6y tha pro- 
)9Ct or, in the case of most psmtlt and persons in thm butinet$/ 
labor induitry cotrmtmity, who actively m proK-rr impi*' 

mantation, "Activaly aMMi$t" includes efforti tuch M atrving as 
resource penons, serving on Advisory Croups, provttUttg work ex- 
perience, etc, 



FORM APPnOVCD 

OMB NO. si.Riirr 



NUMBER OF Participants 

fe»» sort mbov) WHO ABE 



^ACE/ ETHNIC'TY t^u Pmrtieipmtt inejvdint Handlempp»d, Gltltd and Tmltnfd. and Low Income} 



OR ALASKAN 

NA-^-.vC 



ASIAN OR 
PACIFIC 
ISLANDER 



■ LAC K/ 
NEGRO 



CAUCASIAN/ 
WHITE 



TOTAL 
ftuB\ of coimia (I) 
Ihroiigh (Sj) 



Of THE TOTAL fcoJiw*! (4) 
NUMBER WHO ARE 



OF THE TOTAL (colmm (4j 
NUMBER WHO ARE 



HANDI* 
CAPPED 



GIFTED AND 
TALENTED 



L0« INCOME 



CLEMENT AMY (K-i) 



MiOOLE/jUNIOR MIQH <7'»J 



1690 



2540 



450 



4680 



720 



240 



2106 



2481 



2199 



SCNIOM HIGH flO*13} 



2-rEAR COLLEGE 



4>YEAM COLLEGE 



AOULTS fnon'mairiculmfd) 



SUB'TOTAL 



EDUCATIONAL PERSONNEL 



TEACHERS 



COUNSELORS 



ADMINISTRATORS 



MEMBERS OF THE BUSINESS/ 
LABOR/ INDUSTRY COMMUNITY 



PARENTS 



OTHER r«p»c//yj 



TOTAL 




OC PORM 447, 2/7« 



Evaluation 



Overview 

The evaluation aspect of the project consisted of two major 
components. Those components and the major related questions 
that were addressed are summarized in Table 2. 



TABLE 2 



AN OVERVIEW OF THE PROJECT EVALUATION COMPONENTS 
AND RELATED QUESTIONS 



RELATED QUESTIONS 



COMPONENT 

!• Evaluation of p .^ogram 1, 
installation in the five 
ongoing Alliance districts 



How effective were the staff 
development sessions in training 
teachers (and others) to use 
the indicated career education 
materials? 



2. Were the beneficial effects of 
the respective programs in terms 
of student impact still evident 
following their districtwide 
installation? 



II. Evaluation of program 
insti; nation in the 
four "new" districts 



3. How effective were the district- 
wide installation efforts in 
meeting their proposed goals? 

4. How effective were the staff 
development sessions in training 
the "demonstration" teachers 
(and others) to use the indicated 
career education materials? 



Were the beneficial effects of 
the respective programs (in 
terms of their student impact) 
still evident when they were 
installed in districts that 
were not involved in their 
development? 

How effective were the trans- 
portability efforts in terms of 
meeting their proposed goals? 



In the materials that follow, the data collection procedures 
and instrumentation employed during the evaluation are described, 
the evaluation results are reported on a component-by-component 
basis, and several general conclusions regarding the observed 
evaluation findings are discussed, 

Data Collection Procedures/Instrumentation 

The initial evaluation component specifiec' in Table 2 is 
concerned with (a) assessing the efficacy and effectiveness of 
the installation processes occurring in the five ongoing 
Alliance districts that cooperated in the project and (b) 
documenting/describing the dissemination processes defined and 
operationalized via those various installation efforts. 

As indicated in Table 2, this component was operationalized 
in terms of three broad questions. The first of those questions, 
which dealt with the effectiveness of the districts' respective 
staff development activities, involved the collection of several 
types of evaluative data. Those data include the following: 

• cognitive and affective perfor-Mance scores for the 
teachers who participated in the respective staff 
development programs and 

• quantitative summaries of the teachers' perceptions 
of the relative value and utility of the staff 
development programs as they relate to the use of 

the various project-related career education programs. 

Figure 2 provides an overview of the associated data collection 
activities and their sequencing as related to assessing the 
effectiveness of the installation efforts in the cooperating 
Alliance districts • 
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FIGURE 2 



An Overview of the Strategy for Evaluating 
the Alliance Districts' Inservice Efforts 



DISTRICTS: 



(1) 

Charleston, SC 



(5) 

Salinas, CA 







Career 


Career 


Career 


Career 






Exploration 


Planning 


Exploration 


Planning 


TtTTEFmjTlCiiS/PCriVTriES 


Program 


Program 


Program 


Program 


1. 


Prior to initiation 


— 


— - 


— - 


— — 




of staff developnesnt 












program 










2. 


Inplenf>entation of 


Career 


Career 


Career 


Career 




staff developnent 


Exploration 


Planning 


Exploration 


Planning 






Inservice 


Inservice 


Inservice 


Inservice 


3. 


Inmediately followiivg 






Xl 






staff developnent 


4. 


Using the respective 


Use of 


Use of 


Use of 


Use of 




career ediication 


Career 


Career 


Career 


Career 




programs 


Exploration 


Planning 


Exploration 


Planning 






Program with 


Program with 


Program with 


Program with 






students 


students 


students 


students 


5. 


After conpleting the 


Y* 


Y 


Y 


Y 




career education 












programs 











*The indicated instruments are described in the accompanying text. 



13 



ERIC 



The instruments } isted in Figure 2 (copies of which can be 

found in Appendix B) are as follows: 

Xi - a criterion test dealing with the concepts, 
components, etc., in the Career Exploration 
Program. That instrument contains a cognitive 
segment designed to assess the respondents' 
knowledge/understanding of the key career 
education and pedagogical concepts that were 
to be covered during the training program and 
an affective segment designed to assess the 
respondents' general attitudes toward the 
training session . 

X2 a criterion test dealing with the Career 

Planning System, which is parallel in content 
and structure to X^. 

Y - a brief questionnaire that provides the 

respondents with an opportunity to critique 
the inservice training they received based 
upon their subsequent experiences using the 
materials that represented the foci of those 
training efforts. 

The data generated via X^ and X2 have been summarized in 
tabular form and are presented in the section that follows. The 
questionnaire data were tabulated, descriptive statistics 
generated, and the resultant summaries presented along with the 
criterion test results in the next section. 

The data collection activities related to the question of 
the beneficial impact of the respective career education programs 
upon students following the districtwide dissemination/ implemen- 
tation efforts were undertaken via a series of strategies such 
as those depicted in Figure 3. A review of that figure reveals 
that: 

1. The basic data collection scheme employed with 
the Career Exploration Simulations, both the 
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FIGURE 3_ 

An Overvia^ of the Strategy for Aasesaing Program Inpact of Students in the Alliance Districts 
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simulations are not equivalent to tests 
employed in the standard versions of the 
same title — e.g., the test for Wilawala - 
Standard is not the same as the test for 
Wilawala - Resource.) 

X3 - cognitive test used to assess student 
knowledge/understanding of certain key 
concepts, interests, etc., associated with 
up to four occupations that he/she has 
studied while working with the Standard 
version of the Career Planning System; 
(The test that one individual takes may or 
may not differ slightly, moderately, or 
completely from that taken by s meone else-- 
see the test instructions presented in 
Appendix C. ) 

S2 - student perceptions of "what*' and "how much" 
they learned from the CPS — parallel in 
content and orientation to S^; and 

T2 - teacher perceptions of "hov/ much" their 
students learned and their attitudes 
toward the CPS — parallel in content and 
orientation to Tj^ • 

¥3 - an affective-oriented criterion test 

completed by students who were exposed to 
the resource version of the CPS. (It is 
similar in orientation and focus to an 
abbreviated version of Crites' "Career 
Maturity Inventory" and has a relatively 
low reading level.) 

The student impact data as measured by the previous 

instruments were tabulated and summarized by career education 

program across districts. The comparisons among program and 

"control" classes were analyzed using analyses of variance 

techniques--i.e. , a nested or hierarchical analysis approach 

was employed. 

The third question considered in relation to this component 
"How effective were the districtwide installation efforts in 
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meeting their (respective) proposed goals?"^ — was addressed via 



the following kinds of data and data collection activities: 

1, The sununary results obtained via the activities 
described in relation to the two initial questions 
were used to indicate the effects of the various 
districtwide installation efforts with regard to 
teacher learning and attitudes, teacher assessments 
of the utility and value of the inservice sessions 

in preparing them to use the various career education 
materials, and students' learning and attitudes. 

2. Records of relevant activities in the five 
cooperating Alliance districts were reviewed and 
on-site interviews with participating teachers and 
other professional staff were conducted in two of 
the districts in an effort to further document and 
describe the respective installation efforts. The 
data collected via these reviews and interviews 
dealt with the major variables to be included in 
the various district installation plans. Those 
different variables are listed in Figure 4. 

Once the various types of data noted above were collected 
and summarized, they were compared with the projections and 
related estimates specified in the respective districtwide 
installation plans. The observed discrepancies between the 
summary/documentary data and the projections/estimates contained 
in the plans were used as the basis for addressing the third 
question raised under this component of the evaluation. 

In addition to providing the preceding kinds of evaluative 

information, the various district installation plans and related 

If 

sets of summary data were combined to form the basis for a case 
study of the installation process. The case study systematically 
describes and docuiuents the respective installation strategies/ 
plans and points out their inherent strengths and weaknesses 
based upon the observed empirical data. It is also accompanied 
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FIGURE 4 



Characteristics of an Effective 
Installation Process 



1. The process is responsive to the district's perceived needs. 

2. Communication is targeted to a variety of viewpoints within 
the community. 

3. The methods of introducing the career education programs to 
staff not involved in the original development and testing 
process are consistent with the philosophy that the programs 
should be continually adapted and expanded to meet the class- 
room needs perceived by the teacher. In this way a feeling 
of ownership is created. 

4. The objectives for installation are attainable over short 
periods of time so that staff can experience relatively 
rapid success with the process. 

5. The budget for materials and staff development is sufficient 
to enable teachers to receive training and programs on a 
timely basis. 

6. The installation process contributes to systematic renewal 
within the district. 

7. Staff responsible for coordination and staff development 
receive their training early enough so that they can carry 
out their responsibilities confidently and adequately. 

8. The time devoted to coordination is sufficient to ensure 
that teachers' needs are being met. Given the general 
scarcity of resources in most local agencies, the amount of 
time and effort required for successful coordination of 
career education installation is designed to be minimal. 

9. The process contains opportunities for endorsements from 
teachers and counselors , administrators , students , and 
community representatives. 

10. The process involves leaders in the schools and community. 

11. Advisory councils and other methods for community involve- 
ment are established so that the community seeks ways 
actively to support and expand the program. 
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by recommendations for enhancing the efficiency and effectiveness 
of comprehensive installation efforts on a districtwide level. 

The second major component of the evaluation focused upon 
assessing the effectiveness of the installation procedures/efforts 
in the four "new" districts that participated in the project. 
It, like component one, was operationalized via three broad 
questions. Those questions and the related data collection 
procedures/instrumentatj on were quite similar in focus and intent 
to those described for i:omponent one (e.g., the criterion measures 
used to assess program impact upon students were equivalent) . 
Therefore, detailed descriptions of those procedures and related 
instrumentation are not repeated at this point. 

Figure 5 provides a summary of the numbers of districts, 
teachers/professional staff members, and classes/students that 
were involved in the two components of the evaluation and provided 
usable data. 

Evaluation Findings - Component One 

As indicated earlier, this component of the evaluation dealt 
with the effectiveness of the installation efforts in the ongoing 
districts that cooperated in the project. It was operationalized 
via three major questions. In the materials that follow^ these 
questions and the related data results are presented and 
described. 

" How effective were the, staff development sessions in 
training teachers (and others) to use the indicated career 



ERLC 



15 

20 



FIGURE 5 



Summary of Agencies and Individuals 
Providing Usable Evaluation Data 

NUMBERS CaF AGE2dES/lM)IVIDUALS INVDLVED 



COMPONENT OF 
EVALUATION 


CAREER EDUCATICW 
PROGRAM ELEMElTr 


(1) 

Districts 


(2) 
Teachers 
ana Staffs 


(3) 
Classes/ 
Students 


I. Districtwide 
Installation 
Efforts in 
"Ongoing" 

UX3 UX US 


Career Exploration, 
Standard Ver'sion 

Career Exploration, 
Resource Version 

Career Planning, 
Standard Version 


4 
4 
4 


39 
7 


51/1012 

11/147 

12/301 




Career Planning, 
Resource Version 


4 




3/25 


II. Installation 
Efforts in 
••New" 
Districts 


Career Explorat"'on, 
Standard Version 

Career Exploration, 
Resource Version 


4 
4 


52 


60/1414 

15/186 




Career Planning, 
Standard Version 


4 


21 


10/210 




Career Planning, 
Resource Planning 


4 


2/27 



*The staff development tests did not differentiate between 
users of standard and resource versions. 
**One district did not return usable data. 
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education materials ?" This question was addressed via the 
collection of both cognitive and affective criterion data from 
the affected teachers and other professional staff members in 
each of the cooperating sites and obtaining their perceptions 
of the value and utility of the Inservlce training they received 
via a short questionnaire. The cognitive criterion data are 
sununarized in Table 3 and the affective data, in Table 4. 



TABLE 3 

STAFF DEVELOPMENT COGNITIVE TEST RESULTS 

Ongoing Districts 







Mean 


% 


Programs 


N 


Correct 


Correct 


Career Exploration Simulations 


39 


9.16 


76 


Career Planning System 


7 


9.17 


76 



Tables 3 and 4 indicate that teachers and other staff 
performed uniformly well on the cognitive tests for the two 
programs and had comparable affective responses to the programs. 
Based on the evaluation results, it can be concluded that the 
staff development sessions were effective in training staff to 
use the career education materials and that teachers had positive 
attitudes concerning their impending use of the programs, 

"Were the beneficial effects of the respective programs in 
terms of student impact still evident following their district- 
wide installation ?" ^. A diversity of complementary types of data 
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TABLE 4 

STAFF DEVELOPMENT AFFECTIVE RESPONSES 



Teachers responded to the items listed by indicating whether they: 
5 - Strongly Agreed; 4 - Agreed; 3 - Neither Agreed nor Disagreed; 
2 - Disagreed; 1 - Strongly Disagreed. 



Ongoing Districts , 



Response Items 



Career 
Exploration 


CPS 


4 .28 


4.25 


4.04 


4 .25 


4.80 


4.75 


4.52 


4.75 




A 

4 • 3 U 


4. 60 


4.25 


4.40 


4 .75 


4.16 


4.00 


4 . 52 


4.50 



1- I feel that I understand the 
major purposes and goals of 
the program. 

2. I now feel that I have an 
understanding of the basics 
of career development theory. 

3. It is important to make 
students aware of how basic 
skills relate to job 
performance . 

4. Career education concepts 
should be infused into 
instruction in academic 
subjects . 

5. Career education concepts 
could be easily infused into 
my curriculum. 

6. Simulation/CPS is a good 
technique for career exploration. 



7. 



8. 



Simulation/CPS is a good tool 
for teaching students about 
jobs. 



well . 

9- Simulation/CPS will reinlorce 



10, The staff development leaders 

conducted this session effectively. 
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was collected in an effort to respond to this question. 
Probably the most basic and potentially valuable of these data 
were the affective and cognitive criterion test data collected 
from both "control^' and program students who were involved in the 
evaluation effort. Table 5 contains several descriptive statistics 
for those various data sets as well as summaries of the comparative 
analyses involving the performance levels of "control" and 
program classes/groups. 

The information presented in Table 5 suggests that the same 
dramatic student impact observed for the respective career edu- 
cation programs during pilot testing and field testing were not 
as evident during the current more widespread intra-distr ict 
installation efforts. Only in the case of the CPS were the 
cognitive performance levels of the program classes significantly 
greater than the performance levels of their respective "control" 
classes. In the case of the affective criterion no such signifi- 
cant differences were found. Although in the majority of instances 
the observed performance levels for program classes were somewhat 
higher than the comparable performance levels of their "controls/" 
only in the two instances noted above were the observed differences 
of statistical significance. 

Any of a diversity of explanations could account for the 
equivocal results found in Table 5. Several of the more obvious 
of those explanations are as follows. 



19 

24 



ThBL£ 5 

aWIARY OP SlUDEOT OOTERICN DMA ^Miili^^n^ 



AVEfVySS CRITERION PERPCBNANCE 



PROGRAM 
Career 
Exploration 
Sinulatiorui 



•Career 
Planning 
System 







NUMBERS OF 


Career Knowledge 


Affective Assessments 




GROUP 


Classes 


Stuclents 


Groif) Mean 


t-Valui 


Groqp Mean 


t-^alue 


(AifltAnaara veriionfl 
(IrcSKr City 


Program 
Control 




76 
85 


10. 8 
10.5 


.2 


73 .8 
71.7 


.6 


(2) Convention 


Program 
Control 




77 
82 


13.4 
13.4 


.0 


83.7 
80.1 


.7 


(3) Ills of Milltown 


Program 
Control 


I 


215 
81 


12.7 
10.2 


2.6* 


37.8 
36.3 


.6 


(4) Sh-.rttails 


Program 
Control 


I 


117 
70 


15.4 
13.0 


1.4 


43.6 
40.2 


1.5 


(5) Wilawala 


Progrewi 
Control 


7 
6 


110 
99 


14.7 
15.2 


.2 


51.8 
53.1 


-.5 


**A11 Standard Versions 




— 


— 


— 


1.7 


— 


1.3 


(B) Resource Versions 
(-L; LonvendOii 


Program 
Control 


3 


40 

1 A 


10.8 

11 Q 


-.5 


75.6 

/7 . 0 


-.4 


(2) Shirttails 


Program 
Control 


3 
3 


35 
42 


13.1 
11.1 


.6 


43.4 
40.5 


.7 


(3) Wilawala 


Program 
Control 


1 
0 


16 
0 


15.9 
N.C. 


N.C. 


48.1 


N.C. 


**A11 Resource Versions 










.1 




.7 


(C)CPS-StaixJard Version 


Program 
Control 


8 
4 


202 
99 


2.5 
2.0 


2.6* 


N.C. 
N.C. 


N.C. 


(D)CPS-Rnource Versiori 


Pretest 
Poettest 


3 


25 


N.C. 
N.C. 


N.C. 


38.8 
39.9 


1.0 



♦Significant at X » .oS level; N.C. - Not Catpleted 

**T:he ocnposite test statistics reported are B-tests (not t-tests) based \3pcx1 the aggregation of the 
respective sets of independent t-values. 
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(1) The career education programs under consideration are 
not that effective in terms of impacting upon student performance 
as measured by the selected criteria, which is directly counter 
to the pilot and field test results obtained over the last five 
years . 

(2) The inservice and related installation delivery 
mechanisms were not effective in developing the appropriate 
teacher/staff interests and usage patterns, thereby resulting in 
less effective utilization of the career education progranis than 
occurred during the earlier tests. 

(3) The control classes and teachers in the districts are 
"contaminated" in the sense that the earlier testing efforts, 
related publicity, and initial impetus for developing the various 
career education materials have had an effect of one sort or 
another upon their criterion-related performance and attitudes. 
(Some support for this contention can be observed by comparing 
the average performance levels reported for the "control" classes 
in the "ongojng" and "new" districts. Such a comparison reveals 
that in the majority of cases reported the performance levels of 
the "control" classes in the ongoing districts are higher than 
those of the "control" classes in the new districts. See Tables 
5 and 11. ) 

(4) The sample sizes, i.e., numbers of classes of students, 
included in the project, and considered via the reported analyses 
were too small and the resulting test statistics lacked sufficient 
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power to detect differences amonu the program and "control" 
groups on the performance criteria. 

(5) Some combination of two or more of the preceding 
explanations could account for the observed results. 

Given the plausibility of these potential explanations 
and the rather equivocal set of findings presented in Table 5, 
it cannot be argued that the various districtwide installation 
procedures/efforts were all effective in terms of the desired 
impact on students. Instead, it should be noted that those 
efforts did appear to be effective in certain instances and of 
questionable/limited effectiveness in others. 

The findings shown in Table 5 are supported by selected 
perceptual data/assessments obtained from both program students 
and teachers/staff who used the various career education programs 
in the cooperating districts. Those perceptual judgments are 
summarized in Tables 6, 7, and 8. Generally speaking, the 
perceptual information reported suggests that the respondents 
felt that students learned some acceptable level of knowledge 
about jobs, workers, and work-related interests from their 
exposure to the various career education materials. 

In summary, the available data related to the impact of 
the "installed" programs on student performance are slightly 
positive, but equivocal. That is, they suggest that the district- 
wide installation procedures/efforts in the cooperating Alliance 
districts were differentially effective in terms of bringing 
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SUGARY OF PR0GRM4 STimTT FEICEFIUMi DATA— 
SIMUlAriGNS - ONQOING DISTRICIS 



(%ASE) RESPCNSE DlgnUBUTlONS* 



(A)St^tf1dard Versiottfl (B)Reaouroe Versiona 



ITEMS 



REIATBD RESPGNSES 


(1) Cpdnr City 


(2) Convention 


(3) Ills of Milltown 


(4) Shirttails 


1 

is 

in 


All Standard Versions 


1 

5 

H 


(2) Shirttails | 


1 


All Resource Versions 


A. 


YeSf very nuch. 


16 


41 


12 


28 


Jo 


23 


IJ 


34 




28 


B. 


Yes. 


39 


33 


41 


39 


35 


38 


60 


49 


NC 


52 


C. 


Yea, a little. 


35 


16 


39 


26 


21 


30 


20 


14 


NC 


16 


D. 


No. 


6 


4 


3 


4 


7 


5 


0 


0 


HC 


0 


E. 


I can*t say. 


4 


6 


5 


3 


2 


4 


7 


3 


NC 


4 


A. 


YeSf very much. 


27 


30 


13 


18 


24 


20 


33 


23 


NC 


26 


B, 


Yes. 


36 


43 


40 


53 


46 


43 


33 


40 


NC 


38 


C, 


Yes, a little. 


25 


14 


29 


16 


16 


22 


13 


26 


NC 


22 


D, 


No. 


9 


10 


14 


10 


6 


10 


7 


3 


NC 




E. 


I can't say. 


3 


3 


4 


3 


8 


5 


14 


8 


" 




A, 


Yes# very much. 


24 


36 


14 


19 


32 


23 


20 


34 


NC 


30 


B. 


Yes. 


36 


36 


42 


48 


44 


41 


27 


40 


NC 


36 


C, 


Yes^ a little. 


21 


10 


27 


12 


14 


19 


29 


14 


NC 


18 


D. 


No. 


10 


10 


12 


11 


8 


11 


13 


12 


NC 


12 


E. 


I can't say. 


9 


8 


5 


10 


2 


6 


13 


0 


NC 


4 


A. 


Yea# very much. 


15 


31 


10 


18 


\^ 


16 


40 


23 


NC 


28 


B. 


Yes. 


29 


20 


29 


28 


41 


30 


40 


34 


NC 


36 


C. 


Yes, a little. 


22 


17 


27 


23 


14 


22 


20 


6 


NC 


10 


D. 


No. 


30 


25 


28 


23 


17 


25 


0 


28 


NC 


20 


E. 


I can't say. 


4 


7 


6 


8 


9 


7 


0 


9 


NC 


6 



Has this siiDulation helped 
you learn more about whkt 
workers do in their jobs? 



Has this aijrulation helped 
you learn more about what 
different workers liJce and 
what they can do? 



Has this siJTUlation helped 
you learn about the jobs 
y ou like and the jobs you 
don't liker 



Has this aiittilation helped 
you think about jobs you 
might choose? 



*lhe mnters specif iod represent percent^rJea rounded to the nearest whole percent. 
NC - Not Cdipleted (insufficient data). 
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'I' flkU *: / 

SlMARy CF PROGRAM STUDCDT PERCEPTUAL DAim— 

CPS - ONGOING Disraicrs 









ITEM 


(%age:} 








RESPONSE DISTOIBOTIONS 








Standard 


'Resource 


ITEMS 


VELKIED RBSPCNSES 


Version 


Version 


Hsa t-hA r*P5^ htf^lwH 

nciO UK? ^*JrO IICX^XXI 


A. 


YeSf very much. 


34 


50 




B. 


Yes, sane. 


52 


48 




Li 


YeSf cut very iittxe. 


7 


2 




D. 


No, not at all. 


2 


0 






1 can u say. 


5 


0 




A. 


Yes, very much. 


31 


50 


you learn more about 




les, Sonne. 


52 


43 


1 &a/W j\J\JU» f3\Jl MBkJL 


c. 


Yes, but very little. 


8 


2 


4JtUCXC0W«9 CUfLl 


O. 


NO, not at cLLi. 


3 


0 


aKi 1 ■{ f*! pa dT'P 


E. 


I can't say. 


6 


5 












Miat" "i ft dnne in 

WAKll* XO \J&^n KS X4I 










different jobs? 










Has t>£ CPS helped 


A. 


Yes, very mucn. 


49 


56 


ywU XOCLLII OJ^iJvlU WlULV^A 


B. 


Yes, some. 


42 


38 


JUKJCI 111X^1 iU XXiSC 




Yes, out very iirrie. 


6 


3 


Aiv^ uH^r^Vi vmoii 
CUu Wiixwll jsJOo yvAil 


r\ 
Ui 


NO, nou at axi. 


2 


3 


might not liJce as 


fill 


I can t sdsy. 


1 


0 












Haq f:Vuai ArvYvi¥*Aafvi 


A. 


Yes, very much. 


60 


36 


jrV/U LA^ UULIUV CMJLA4U 


B 

u ■ 


Yes . flone . 


26 


50 


ywU£ X u v*Ux c • 


C. 


Yes, but very little. 


7 


2 




0. 


No, not at all. 


4 


0 




E. 


I can't say. 


3 


12 


Has the CPS helped 


A. 


Yes, very mudi. 


33 


41 


you *decide which high 


B. 


Yes, some. 


39 


46 


school oourses and 


C. 


Yes, but very little. 


17 


0 


extracurricular 


D. 


No, not at all. 


9 


3 


activities you should 


E. 


1 can't say. 


2 


10 


consider choosing? 









♦For the resource version, this iton \mB restated as follows: "... decide which 
studies and activities you should choose?" 
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SP«]LATICHS M) C7S > ONlOr^G DISTRICTS 



ITa4 BESPCN^ DISnOHTrXMS 



SIMUIAnONS 



Standard verilois Resource Verilons 





REUmZ) RESPOGCS 


(1) rrrtar City 


(2) GonvGntion 

1 


(3) Ills of Mi 11 town 


(4) Shirttails 


In 


All Standard Versions 


(1) Oonvention 


(2) Shirttails 


10 

! 


1 

B 

1 

r, 

i 

rH 

i 


Standard 
Version 


Resource 
Version 


How would you rate students' 


A. 


Excellent 


0 


0 


0 


0 


25 




100 


0 


N.C. 


33 


20 


20 


owall rosponse to the 


B. 


Mill above average 


33 


80 


100 


43 


25 


50 


0 


50 


N.C. 


33 


70 


40 


•sijaulaticr/CPS— how w^ll 


C. 


Slightly above average 


67 


20 


0 


29 


25 


25 


0 


0 


N.C. 


0 


10 


20 


did nest students like rising 


D. 


Minijnally acceptable 


0 


0 


0 


14 


25 


15 


0 


50 


N.C. 


33 


0 


20 


ths matsrlals and spsnding 


£. 


Poor 


0 


0 


0 


14 


0 


5 


0 


0 


N.C. 


0 


0 


0 


thsir class tline working 






























with ths *Bi;tiilationA3>s? 






























How would you rate student 


A. 


Adequately acccqplished for most students. 


0 


20 


0 


33 


25 


21 


0 


0 


N.C. 


0 


30 


20 


9Qsl achiflwnent (in terms 


B. 


Adequately aooaif>lished for sone, 


100 


60 


100 


33 


50 


58 


100 


50 


N.C. 


67 


60 


60 


of increases career knowledge/ 




miniiiiftlly aooonplished for others. 


























iinproved career decision- 


C. 


Minijnally acooiftlished for most. 


0 


0 


0 


17 


25 


10 


0 


0 


N.C. 


0 


10 


0 


nsJdng skills, increased 


D. 


Little achievmnt for most. 


0 


20 


0 


17 


0 


11 


0 


50 


N.C. 


33 


0 


20 


self-awereness) 7 


£. 


No adiievtanent fca: nost. 


0 


0 


0 


0 


0 


0 ' 


0 


0 


N.C. 


0 


0 


0 


C3>S ONLY 






























How would you rate the 


A. 


Very high - ocRpared to past classes, 






















0 


20 


iiqpact the CaB has upon 




the factors oonsidered, the tijne 


























the degree of itudent 




spent, and the interests dononstrated. 


























ijivolvenent in the career 


B. 


High - coqpared to past classes, greater 






















80 


40 


dmlopnent/career choice 




maturity indicated for some students. 


























pcooess (as revealed by 


C. 


Median - catpared to past claises, greater 






















20 


20 


their construction of a 




maturity indicated for a stixlents. 


























high school plan)? 


D. 


Low ^ oonfsared to past classes, greater 






















0 


0 






maturity indicated for no students. 




























B. 


I can't say. 






















0 


20 






NUMm OF RESPONDOnS 


3 


5 


1 


7 


4 


20 


1 


2 


0 









^Specific simulation title was given on the teacher's questionnaire. 
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about dramatically/significantly higher program student per- 
formance levels on the selected cognitive and affective criteria. 
Due to limitations in the related sample sizes , some caution 
needs to be exercised in over-emphasizing this lack of positive 
results and concluding that the related installation efforts were 
ineffectual or only minimally effectual. Rather, it would 
probably be more appropriate to suspend judgment pending the 
•ecurance of a less equivocal data set, if possible. 

''How effective were the dis^.rictwide installation efforts 
in meeting their proposed goals ?" Given the preceding discussion, 
one can conclude that the staff development efforts were effective 
in reaching the proposed goals but that student cognitive results 
were equivocal at best. This would be alarming except for the 
fact that prior evaluation results and program assessments have 
led all of the ongoing school districts to the conclusion that 
the Alliance programs should be installed. 

Each of the districts' installation plans are presented in 
the case study* that is one of the products resulting from the 
project. TMe plans indicate that the districts are confident 
enough to proceed with various forms of program installation. 
In Milwaukee, a decision has been made to install the' Career 
Planning System districtwide in all middle/junior high schools 

•"Prom Salinas to New York City: Case Studies in Career Education 

or 

An Analysis of the Transportability of Career Education Programs 
In the Alliance for Career and Vocational Education" 
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and to utilize the resource materials as the major career 
education component for exceptional education students. In 
Philadelphia, the resource materials and staff development will 
be provided to ninety special education teachers during 1979-80 
and external funding is being sought to disseminate the other 
materials to the many junior high schools in the system. In 
Madison, the Career Planning System is being used with all eighth- 
grade student J and in Salinas, the Career Planning System and 
selected career exploration programs are being used in career 
guidance centers. Finally, Charleston County is continuing to 
expand the use of all materials as funding permits. 

It is clear that involvement in the project being evaluated 
here was important to the ongoing school districts of the Alliance. 
The project gave those districts an opportunity to involve more 
staff and students and to keep their career education "momentum" 
(jt) i nc} . 

Evci luation Findings - Component Two 

This component of the evaluation effort was directed toward 
assessing the effectiveness of the installation procedures/efforts 
employed in the four new districts tha>: participated in the 
project. It, like the first component/ was operationalized via 
thrt^o jna](^r questions. Those questions and the related findings 
are presented and described in the materials that follow. 

"I low o r f eo t i vc* wo r £ the staff development sessions in 
trainincj the 'demonstration' teachers (and others) to use the 
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ind icat ed career education materials ?" The data collected ■ 
relative to this question consisted of cognitive and affective 
test scores for the affected teachers and other professional 
^taff, as well as their perceptions of the value and utility of 
the inservice training tney received based upon their actual 
experiences using the related career education materials. The 
related sununary of those data is presented in Tables 9 and 10. 

TABLE 9 

STAFF DEVELOPMENT COGNITIVE TEST RESULTS 



New Districts 







Mean 


% 


Programs 


N 


Correct 


Correct 


Career Exploration Simulations 


52 


8.71 


73 


Career Planning System 


21 


8.83 


74 



As was tho case with the ongoing districts, staff in the new 
districts showod comparable mastery of the basic concepts pre- 
soiitod for the exploration simulations and the Career Planning 
System. Table 10 indicates that new district staff approached 
program installation with positive attitudes. On-site interviews 
conducted at the end of the school year indicated that staff felt 
prepared to use the programs and did not require assistance during 
thc> implementation process. 
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TADLE 10 

STAFF DEVELOPMENT AFFECTIVE RESPONSES 



Teachers responded to the items listed by indicating whether they 
5 - Strongly Agreed; 4 - Agreed; 3 - Neither Agreed nor Disagreed; 
2 - Disagreed; 1 - Strongly Disagreed. 



New Districts, 



1. 1 feel that I understand the 
major purposes and goals of 
tho protjram. 



2. 



3. 



7. 



8. 



9. 



10. 



T now feel that I have an 
understanding of the basics 
of career development theory. 

It is important to make 
students aware of how basic 
skills relate to job 
performance. 




Simulation/CPS is a good 
technique for career exploration. 

Simulation/CPS is a good tool 
for teaching students about jobs. 

Simulation/CPS will fit into my 
curriculum well. 

Simulation/CPS will reinforce 
the basic skills that I teach. 

The staff development leaders 
conducted this session effectively. 



29 



Career 




4.07 


4.26 


1 79 


4 22 


4. 75 


4.75 


4.69 


4.82 


4.30 


4.36 


4.41 


4.49 


4.05 


4.21 


3.93 


4.54 


4.14 


4.28 


4.33 


4.55 
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" Wo r c ' Lho bi^nof'K :i a I ojT f ( » cts of the re spect ive programs (in 
terms oT their st udent impact) still evident when they were 
installed in districts that were not involved in their develop- 
mont?" The evaluation activities related to this question 
resulted in the collection of a diversity of complementary types 
of data. The most basic and rigorous of those data were the 
affective and cognitive criterion test scores obtained from both 
the program and ^'control" classes/students who cooperated in the 
evaluation effort. Table 11 contains several descriptive sta- 
tistics for those various data sets, as well as summaries of 
related analyses involving comparisons between the criterion 
performance levels of the participating "control" and program 
classes/groups. 

The results exhibited in Table 11 suggest that the various 
career education programs did have a positive impact upon the 
affected students. The only possible exception to this general 
conclusion relates to the various resource versions of the 
Career Exploration simulations. In that instance only the 
"(W(>rall" test statistics for the affective criterion were 
s( i» t Istically significant. One possible explanation for this 
exception relates to the relatively small sample sizes involved 
in using these simulations* As a result of these sample 
.size limitations, the power of the related test statistics 
would be relatively low, thereby decreasing the probability of 
dotectinq significant differences between the program and 
"control" groups. 
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PROGRAM 



GRDUP 



NUMBERS CF 
Classes Students 



AVERAGE CRXTSUOH FERPOmMCE 
AND mXED t-VMUlES 
Career Knci^ledge Affective Assesncnts 

Group Mean t-*Value Group Hm\ t«V>dti> 



•Career 
t:)C()Ioration 
Simulations 



(A) Statidani Versions 

(1) Cedar Cl^ 

(2) Convention 

(3) Ills of Milltown 

(4) Shirttails 

(5) Wilawala 

**A11 Staiidard Versions 

(B) Resource Versions 
CD Convention 

(2) Shirttails 

(3) Wilawela 

**AI1 Resource Versions 



Progran 
Control 

Program 
Control 

Program 
Control 

Program 
Control 

Program 



Program 
Control 

Program 
Control 

Program 
Control 



206 
91 

170 
175 

159 
131 

122 
140 

123 



16 
6 

29 
25 

62 
48 



15.8 
11.9 

14.8 
12.8 

12.3 
9.4 

13.7 
11.3 

17.4 



12.9 
10.7 

16.7 
9.7 

19.2 
18.3 



3.9* 

3.0* 

3.2* 

1.7 

.2 
5.1* 

.9 
1.9 
.7 
.9 



81.1 
72.8 

83.7 
77.6 

41.2 
35.4 

43.0 

39.3 

53.4 



84.1 
55.8 

45.2 
38.2 

53.3 
48.4 



3.2* 

1.7 

2.6* 

2.1* 

.8 
4.4* 

2.0 
1.5 
1.7 
2.0* 



•Career 
Planning 
System 



(C) CPS-Standard Version 
(P)CPS-ResQurce Version 



Program 
Control 

Pretest 
Posttest 



123 
87 

27 



2.9 
2.4 

N.C. 
N.C. 



2.1* 
N.C. 



N.C. 
N.C 

35.5 
39.6 



N.C. 
5.1* 



"^Skjnificant at X = .05 level; N.C. - Not Completed 

**The ooinposite test statistics reported are B-teats (not t-testa) based i^jon the aggregation of the 
respective sets of independent t-values. 
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The less rigorous perceptual data obtained from the 
participating teachers and students generally supports the 
results observed in Table 11. Summaries of those data are 
presented in Tables 12, 13, and 14. 

Overall, the evaluation results related to the impact of 
the selected career education programs on students' performance/ 
behavior are quite positive. They suggest quite unequivocally 
that those programs and the related inservice/installation 
efforts in the new districts were effective in bringing about 
the desired improvements in the affected classes/students' 
cognitive and affective criterion performance levels. 

•V 

"How effective were the transportability efforts in terms 
of meeting their proposed goals ?" This question is identical 
to the third question considered under component one. 

Based on the evaluation results presented above, one can 
conclude that the staff development was conducted effectively 
in the four new districts and that implementation of most of the 
career education programs resulted in significant student 
achievement and positive assessments by students and teachers. 
These positive results were anticipated because of similar 
results that had been achieved in ongoing districts during 
prior years. 

It should be noted, however, that statistically significant 
cognitive development resulting from use of the resource materials 
was anticipated but not achieved in new as well as ongoing 
districts. It is felt that this situation may be attributable 
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T^BLE 12 



SUHMARY Cr PH0GRM4 ffTUDEtrr PEXEPTiMj Dm-- 
SIMWATIONS - MEW DISTIUCTS 



VrOi iWX) RESPONSE DlSTR£H7nON5 



(A) Standard Versions 



(B) Resource Varsicns 



raws 



Hia this siiajlation 
heXpcxl you loom more 
about what workers do 
in their jobs? 



Mas this siiajlation 
helped you loam more 
about what different 
workers like and wSt 
they can '35? 



{las this simulation 
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to inappropriate testing procedures and/or to the fact that 
implementation usually took longer than teachers had planned 
and that therefore they ran out of time and did not complete 
the testing process. This situation should be excunined by the 
Alliance in the future. 



Finally, on-site interviews in the new districts revealed 
that two plan to further install Alliance programs in the 




training will also be provided. In Tucson and Detroit, however , 
organizational variables and the lack of a state of readiness 
for Alliance programs will preclude extended use in the immediate 
future. This situation, and the various reasons for it, are 
examined in detail in the case study cited earlier. The 
conclusion drawn in that document is that many variables, other 
than program effectiveness and positive response, have a signifi- 
cant bearing on a school district's readiness and willingness to 
install the program. 

General Summary 

The basic purpose of the project evaluation activities was 
to assess the overall efficacy and effectiveness of two sets of 
career education program installation efforts in two distinctly 
different groups of school districts. In one of the sets of 
districts the materials being used were originally developed/ 
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tested and were being installed on a more comprehensive, district- 
wide basis. The second set of districts was not involved in 
the original development process and was attempting to install 
the selected career education programs for the first time. The 
data collection procedures, activities, and analyses undertaken 
in regard to these two sets of district-related installation 
efforts served to define the major components of the evaluation. 

The major results and related conclusions evolving from the 
two indicated evaluation components have been discussed in 
detail in preceding sections of the evaluation report. Additional 
information pertaining to decisions to further install Alliance 
programs is presented in the case study emanating from the 
project. 



Two major types of dissemination were planned for the 
project. One involved conferences that the nine school 
districts conducted for a minimum of ten state and local edu- 
cation agencies in each of their areas / for the purpose of 
demonstrating their career education programs and the benefits 
being derived from the project. The second dissemination 
strategy involved the National Center's preparation of a case 
study focusing on the transportability of career education 
programs and drawing on the experience of the nine school dis- 
tricts in 1978-79 as an example of the transportability process • 



Dissemination Activities 
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The school districts conducted the demonstration conferences 
as planned and some of the people in attendance have requested 
more information about the project from the National Center. 
These individuals will receive copies of the case study as will 
approximately five hundred state, intermediate, and local 
agencies. The purpose of disseminating the case study is to 
demonstrate effective processes for transporting and installing 
career education programs. The draft of the case study is in 
the final review stages and should be printed and mailed by 
November 15, 1979. 

Special Activities 

As discussed under "Evaluation," selected components of 
the Alliance's career education program were field tested with 
educable mentally handicapped (EMH) students. In addition, 
Spanish versions of several components were provided for review 
and use in six of the school districts. 

As noted in Table 1, the project served approximately seven 
hundred twenty (720) educable mentally handicapped students in 
grades 7-9 in nine school districts. The objectives for these 
students were to: (a) identify a variety of occupations that 
exist within a cluster area; (b) perform tasks like those that 
workers do on the job; (c) describe how one's own interests 
and abilities match interests and abilities of workers in various 
jobs. In order to accomplish these objectives, the students 
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were involved in the Alliance's career exploration simulations 
and/or Career Planning System, both of which have been modified 
for use with educable mentally handicapped students. 

Table 1 also indicates the number of Spanish-speaking 
students involved in the program. Students in "Career Planning 
System - Spanish** used the translated version of the program. 
Students involved in "Shirttails - Spanish^" "Convention - 
Spanish," and "Wilawala - Spanish," used the English version of 
the program with the assistance of English-Spanish glossaries. 
The objectives for these students were the same as for English- 
speaking students . 

Finally,' it should be noted that Alliance materials have 
been judged to be free of race and sex stereotyping by the 
school districts involved in the Alliance since its inception 
five years ago. The National Center and Alliance districts have 
been very careful to ensure that the programs would be free of 
bias and would include an appropriate balance by sex and race 
in the careers being portrayed. 

Financial Status Report 
The report is contained in Table 15. 
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The objectives for the project, "A Demonstration: Effecting 
Incremental Improvements in K-12 Career Education," were as 
follows . 

If To determine how to install comprehensive career 
education programs on a districtwide basis when 
development and field testing have been completed. 

a* To demonstrate and document the process of 
districtwide installation of the Career 
Exploration Program and the Career Planning 
System in five Alliance school districts in 
which field testing has already taken place, 

b. To evaluate the effectiveness of the comprehensive 
installation process employed by the school 
districts . 

2. To determine how to transport effective career 
education programs from school districts that 
have them to school districts that need them. 

a. To implement the Career Exploration Program 
and the Career Planning System and to evaluate 
their effectiveness with students and staff 

in four school districts not previously 
involved with the Alliance, 

b. To demonstrate and document the process 
involved in installing the programs in 
the four additional school districts. 

The objectives were met through the involvement of nine 

school districts in the Alliance for Career and Vocational 

Education . The five "ongoing" school districts participating in 

the first objective were the Charleston (South Carolina) County 

Public Schools, Madison (Wisconsin) Metropolitan School District, 

Milwaukee (Wisconsin) Public Schools, Philadelphia (Pennsylvania) 

Public Schools, and the Salinas (California) Union High School 

District, The four "new" school districts involved in the second 



objective were the Detroit (Michigan) Public Schools, Montgomery 
County (Maryland) Public Schools, New York City Board of 
Education, and Tucson (Arizona) Unified School District, 

In order to accomplish the objectives specified above/ a 
number of activities took place. These activities are presented 
in Figure 1 in terms of the objectives that they accomplished. 

As a result of project activities, it was found that four 
major factors influenced the transportability and installation 
of Alliance programs. These were (1) goal and model congruence, 
(2) cost, (3) ease of installation, and (4) staff 'and community 
involvement. These factors or characteristics are presented in 
Figure 2 in terms of their relationship to both process and 
product. 

Data from the various evaluation efforts indicated that the 
career education programs were received equally well by staff 
and students in the five "ongoing" districts and four "new" 
districts. All five of the ongoing districts established plans 
for expanded program installation during the 1979-80 school 
year. Two of the "new" districts also planned to further 
install the programs. The two that did not plan on further 
installation cite lack of model congruence or cost as the major 
reasons, even though teachers and students found the programs 
to be acceptable. 
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FIGURE 1 
Sununary of Project Activities 
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Activities 
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lb 


2a 


2b 


Career education directors and staff development 
coordinator received training at the National 
Center in August to prepare for program imple- 
mentation in their districts. 


X 




X 




Career education directors developed instal- 
lation plans indicating arrangements for staff 
development, program evaluation, and community 
involvement in 1978-79. 


X 


X 


X 


X 


The National Center printed and delivered one 
hundred eighty (180) classroom sets of career 
education curriculum materials for use by the 
students involved in the program. Appendix A 
contains a description of the career education 
programs used in the project. 


X 




X 




The district career education directors and 
staff development coordinators trained approxi- 
mately twenty teachers and counselors in each 
district to implement and field test the 
program. 


X 




X 




The Alliance programs were implemented in the 
nine school districts. 


X 




X 




Career education advisory committees were 
utilized in the districts to involve the 
community in the career education endeavor and 
to provide support to the school staff members 
involved in the project. 


X 




X 




School districts conducted conferences for LEA 
and SEA representatives in their areas in order 
to demonstrate the programs being implemented. 


X 






X 


Upon completion of program implementation, 
students in program and equivalent control 
groups took posttests designed to measure the 
cognitive and affective impact attributable to 
the programs. Teachers and students completed 
instruments to show their appraisal of the 
programs they had experienced. 




X 


X 
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FIGURE 1 (continued) 



Activities 



Related 
Objectives 



lb 2a 2b 



National Center project staff conducted site 
visits in the four "new" districts and two 
of the ongoing districts to gather data for 
the case study to be written on the topic of 
the transportability of career education, 
programs. School district administrators r 
career education directors and coordinators, 
and teachers were interviewed. 

National Center project staff processed and 
analyzed the test data and other information 
received from the nine school districts. 

National Center project staff developed the 
case study of the transportability process. 

National Center staff developed the final 
project report. 
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FIGURE 2 



Characteristics of 
Transportable Career Education Programs 



CHARACTERISTICS 


PROCESS 


PRODUCT 


1. 


Goal and Model Congruence 








a . 


Career education has been 
or can be endorsed. 


X 






b. 


Program model is acceptable. 


X 


X 




c . 


Program goals are compatible 
with existing curriculum goals 




X 




Cost 








a. 


Costs for initial instaillation 
are acceptable. 


X 


X 




b. 


Long-range costs appear acceptable. 


X 


X 
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Ease of Installation 








a . 


Installation is attainable over 
a short period. 


X 






b. 


Organizational structure is clear. 


X 






c. 


Coordinators are adequately trained. 


X 






d. 


Coordination time is sufficient 
and requires minimal time. 


X 






e. 


Training for staff installing the 
program is sufficient and requires 
minimal time. 


X 






f . 


Sense of ownership can be developed. 




X 




g- 


Prior evaluation indicates 
likelihood of success. 


X 


X 


A 

4 • 


staff and Conununity Involvement 








a. 


Communication is targeted to 
relevant groups. 


X 






b. 


Community involvement is part 
of the program. 


X 


X 




c . 


Program can be endorsed by 
school and community leaders. 


X 


X 




d. 


Program will contribute to 
systematic staff renewal . 


X 


X 



X = Characteristic involves process and/or product 
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Appendix A 
Career Education Materials 



47 

o 

ERIC 



Career education materials being used in the U.S.O.E. 
project have been developed by the Alliance for Career and 
Vocational Education and include several career exploration 
simulations and the Career Planning System. These materials 
are described briefly below. 

Career Exploration Simulations 

The Alliance for Career and Vocational Education has 
developed several simulations, each depicting a major topic 
from an occupational cluster. These simulations — which include 
worksheets, filmstrips, cassette tapes, illustrated student 
booklets, and other resource materials — enable students to 
experience the work roles of occupational endeavors. This 
opportunity is provided through the students' solving of 
carefully selected and arranged work problems adapted from 
actual situations . 

Alliance simulations each require approximately 15 
instructional hours and may be implemented in a variety of 
subject areas. Students work in groups as they perform work 
functions, and either part or all of the students in a class- 
room may be involved in the simulation activity. 

Simulations being field tested in this project and their 
related subject areas include the following: 
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SIMULATION 



CLUSTER 



SUBJECT AREAS 



Shirttails* 



Trade and 
Finance 



Mathematics , 
Business , 
Social Studies 



Independent retail stores 
are operated. Worker 



roles cover the functions 
of buying, selling, store 



operations, and controlling. 



Convention* 



The staff of a hotel and 
restaurant prepare for a 
large convention. Worker 



Personal 
Services 



Home Econoraics, 
Mathematics , 
Business -related 
courses 



roles include reservation 
clerk, housekeeper, chef, 
cashier/auditor , maid , 
cook, waiter/waitress , 
banquet manager, and 
customer. 



Wilawala Lake Community * Construction Industrial Arts, 

A housing development is Art 
planned and designed. Job 
functions include exterior 
design, interior design, 
plumbing design, electrical 
wiring design, and land- 
scape design. 

Ills of Milltown Health and Science, Health 

Workers in the department Welfare 

of environmental health 

and protection deal with 

several different types 

of pollution in the city 

of Milltown. Worker 

roles include air, water, 

noise, and soil pollution 

technicians. 



♦These simulations have two English versions: one for use in 
regular classrooms or classrooms in which special needs students 
are mainstreamed (Revised Edition), and the other for use in 
classrooms made up of special needs students (Resource Edition) . 
There is also a Spanish version of each of these simulations. 
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SIMULATIONS 



CLUSTER 



SUBJECT AREAS 



Trouble in Cedar City 
Local government workers 
plan for the location of 



Government 



Civics, Social 
Studies , Government , 
Science 



a new highway, which has 
become a controversial 
issue. Worker roles 
include mayor, landscape 
architect , communicator , 
environmental planner, 
neighborhood planner, 
design engineer, traffic 
engineer, and city engineer. 



Career Planning System 

The Career Planning System (CPS) is an individualized 
program designed to help eighth- and ninth-grade students plan 
a high school program. They do this on the basis of their 
interests and abilities and information about occupations related 
to their interests, CPS is implemented in such subject areas as 
language arts, social studies, and careers classes and requires 
approximately 15 instructional hours during the school year. 

The CPS contains the follov/ing materials: 



Progyr am Introduction 

A set of ten transparencies to aid the teacher 
in introducing students to the CPS, its purpose, 
the way it works,, and what the student can expect 
to gain from the program. 

Interest Sort Cards 

The Interest Sort Cards are a set of statements 
about daily activities ("I like to • . ,") that 
the student sorts according to his degree of 
interest in them. On the back of each card is 
the name of a "Probe" to which the interest relates. 

13 Probes 

These ''olders are organized around kinds of worker 
activities, such as arranging, helping, and building 
and making. They "probe" into the most salient 
aspects of the particular area of work and briefly 
introduce four occupations that exemplify the area, 
A list of the Probes and occupations is presented 
in the following section. 
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52 Activities 

For each of the occupations introduced in the Probes 
there is a representative Activity for the student 
to perform: a brief work simulation intended to 
give the student a glimpse of part of the worker's 
job. 

Activity Envelopes 

For Activities that require consumable work materials 
(worksheets f charts^ diagrams^ etc.), there is an 
Activity envelope containing copies of each item. 
Not all Activities have Activity Envelopes. 

52 Occupational Briefs 

These illustrated vignettes of workers (those intro- 
duced in the Probes) provide details about occupations 
and about working conditions. Each Brief also provides 
an outline for preparation for the occupation it 
describes — high school courses and activities and 
preparation after high school. Each Brief is numbered 
and corresponds to the Activity with the same number. 
Booklets are also color coded: all pieces related to 
a particular kind of worker activity are the same color. 

Student Guide 

At the core of the CPS is the Student Guide. It serves 
several purposes: 

• to help guide the student through the CPS; 

• to provide a central record of the student's 
experiences, reactions, and developing interests; 

• to cause the student to reflect upon his CPS 
experiences and to synthesize those experiences 
into a growing awareness of self and work; and 

• to provide the basis for developing a plan for 
the high school program. 

Guide for Teachers and Counselors 
This guide provides information about the nature 
and function of the CPS, alternative strategies for 
its implementation, the role of the teacher and the 
counselor in relation to the CPS, and procedures 
for evaluating materials. In addition, suggestions 
for supplementary activities related to values 
clarification, decision making, and other career 
planning topics are provided for the teacher or 
counselor who wishes to initiate individual or 
group activities and discussion. 
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The following is a list of CPS interest groups and the 
associated occupations. 

1. Advising 

Lawyer 
Teacher 
Travel Agent 
Employment Counselor 

2. Arranging 

Interior Designer 
Hair Stylist 
Architect 
Fashion Designer 

3. Building and Making 

Carpenter 
Painter 
Roofer 
Drafter 

4 . Helping 

Waiter 
Teller 

Police Officer 

5 . Maintaining and Repairing 

Mechanic 
Plumber 

Appliance Repairer 
Sanitation Worker 

6 . Operating Equipment 

Computer Service Technician 

Telephone Operator 

Cook 

Pilot 

7. Performing 

Actor 
Musician 
Disc Jockey 
Model 
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8. 



Performing Clerical Duties 



Secretary 
Cashier 
Sales Clerk 
Pile Clerk 

9 . Persuading 

Public Relations Worker 
Insurance Salesperson 
Advertising Account Executive 
Real Estate Salesperson 

10. Thinking in Pictures 

Medical Illustrator 
Cartoonist 
Display Artist 
Commercial Artist 

11 . Using Information About the Environment 

Environmental Technican 
Pish and Game Warden 
Parmer 

Meteorologist 

12 . Working with Numbers and Symbols 

Medical Laboratory Assistant 
Computer Programmer 
Cartographer 
Accountant 

13 . Writing 

Copywriter 
Newspaper Reporter 
Technical Writer 
Pilm Critic 



In addition to the regular classroom version (Revised 
Edition) of the Career Planning System, there is also a 
Resource Edition of the program designed for use with special 
needs students. 
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Appendix B 
Staff Development Tests 
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STAFF DEVELOPMENT EVALUATION FORM 
CAREER EXPLORATION SIMULATIONS 



Please fill in the name of your school and your school district. 
Then circle the correct answer for each question. 

School 

School District 



1. Most career development theorists agree that career 
development occurs in what sequence? 

a. career exploration, career awareness, career preparation 

b. career preparation, career exploration, career awareness 

c. career awareness, career preparation, career exploration 

d. none of the above 

2. The major goal of career exploration is for students to: 

a» learn how their interests and abilities match those 
needed on the job. 

b. choose a job. 

c. learn employability skills. 

d. select a high school course of study. 

3. The career explor":tion progrcun is designed for: 

a. college-bound students* 

b. students bound for two-year postsecondary programs. 

c. students bound for vocational schools. 

d. all of the above. 

4. Infusion of career education concepts would be most likely 
to occur in what subject area? 

a. language arts 

b. industrial arts 

c. math 

d. all of the above 

5. What is the rationale for using simulation as a strategy 
for career exploration? 

ae simulation is a good technique for teaching basic skills 

b. simulation is a good placement technique 

c. simulation allows students to "try out" occupations 

d. simulation is a technique that prepares students to 
perform real jobs. 
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6. Alliance simulations are: 

a. organized on the basis of occupational clusters. 

b. organized on the basis of interest areas. 

c. restricted to occupations in business and industry. 

d. none of the above. 

7. What process was used in the development of Alliance 
career exploration materials? 

a. field test, cooperative planning 

b. pilot test, cooperative planning, field test 

c. field test, cooperative planning, field test 

d. cooperative planning, pilot test, field test 

8. In Alliance simulations, students primarily work: 

a. alone. 

b. in groups of 4-10 students. 

c. as a whole class. 

d. at home. 

9. What is the recommended duration of an Alliance simulation? 

a. 2-3 instructional periods 

b. a semester 

c. 25 instructional periods 

d. 10-15 instructional periods 

10. The function of the Introduction phase of Alliance 
simulations is to: 

a. allow students to select an occupational role. 

b. define the occupational cluster area. 

c. encourage further exploration. 

d. give students instructions for performing job tasks. 

11. The primary purpose of the Preparation phase of Alliance 
simulations is to; 

a. describe simulation occupations so that students 
can make role choices. 

b. teach students skills they need to perform job tasks. 

c. introduce students to the occupational cluster 
represented by the simulation. 

d. all of the above » 

12. Upon completion of a career exploration simulation, 
students are expected to: 

a. find part-time jobs. 

b. continue exploration of occupations. 

c. know whether they want to attend college. 

d. enter a vocational program. 
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Please circle the number that best represents your response 
to each statement. 

5 - Strongly Agree 

5 - Agree 

3 - Neither Agree nor Disagree 

2 - Disagree 

1 - Strongly Disagree 



Strongly 
Agree . , 



1. I feel that I understand the 
major purposes and goals of 
the program. 

2. I now feel that I have an 
understanding of the basics 
of career development theory. 

3. It is important to make students 
aware of how basic skills relate 
to job performance. 

4. Career education concepts should 
be infused into instruction in 
academic subjects. 

5. Career education concepts could 
be easily infused into my 
curriculum. 

6. Simulation is a good technique 
for career exploration. 

7. Alliance career exploration 
materials are good tools for 
teaching students about jobs. 

8« The career exploration simulation 
that I reviewed will fit into my 
curriculum well. 

9. The career exploration materials 
will reinforce the basic skills 
that I teach. 

10. The staff development leaders 

conducted this session effectively. 



3 
3 



Strongly 
Disagree 

2 1 



2 1 

2 1 

2 1 

2 1 

2 1 

2 1 

2 1 

2 1 

2 1 



57 

6S 



STAFF DEVELOPMENT EVALUATION FORM 
CAREER PLANNING SYSTEM 



Please fill in the name of your school and your school district. 
Then circle the correct answer for each question. 

School^ 

School District 



1. Most career development theorists agree that career 
development occurs in what sequence? 

a. career exploration, career awareness, career preparation 

b. career preparation, career exploration, career awareness 

c. career awareness, career preparation, career exploration 

d. none of the above 

2. One of the major goals of the Career Planning System is 
for students to: 

a. learn how to interview for a job. 

b. choose a job« 

c. learn employability skills. * 

d. select a high school course of study. 

3. The Career Planning System is designed for; 

a. college-bound students. 

b. students bound for two-year postsecondary programs. 

c. students bound for vocational schools. 

d. all of the above. 

4. Infusion of career education concepts would be most likely 
to occur in what subject area? 

a. language arts 

b. industrial arts 

c. math 

d. all of the above 



5. What is the rationale for using the Career Planning 
System as a strategy for career exploration? 

a. The CPS is a good program for teaching basic skills. 

b. The CPS is a good program for job placement. 

c. The CPS allows students to "try out" various occupations. 

d. The CPS prepares students to perform real jobs. 
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6. The Career Planning System is: 

a. organized on the basis of occupational clusters. 

b. organized on the basis of interest groups. 

c. restricted to occupations in business and industry. 

d. none of the above. 

7. What process was used in the development of the Career 
Planning System? 

a. field test, cooperative planning 

b. pilot test, cooperative planning, field test 

c. field test, cooperative planning, pilot test 

d. cooperative planning, pilot test, field test 

8. The Career Planning System is: 

a. a career exploration progrsun in which students work 
in groups of 4-10. 

b. an individualized career exploration program. 

c. a career exploration program in which students work 
as an entire class. 

d. a home-instruction career exploration program. 

9. What is the recommended duration of the Career Planning System? 

a. 2-3 instructional periods 

b. the whole school year 

c. 25 instructional periods 

d. 10-15 instructional periods 

10. The function of a CPS "Probe" is to: 

a. allow students to perform in a work role. 

b. describe an occupational interest group. 

c. help students keep records of career exploration experiences. 

d. give information about a specific occupation, working 
conditions, salary, etc. 

11. The function of a CPS "Brief" is to: 

a. allow students to perform in a work role. 

b. describe an occupational interest group. 

c. help students keep records of career exploration experiences. 

d. give information about a specific occupation, working 
conditions, salary etc. 

12. Upon completion of the CPS, students are expected to: 

a. find part-time jobs. 

b. continue exploration of occupations. 

c. know whether they want to attend college. 

d. enter a vocational program. 
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Please circle the number that best represents your response to 
each statement. 

5 - Strongly Agree 
4 - Agree 

3 - Neither Agree nor Disagree 

2 - Disagree 

1 - Strongly Disagree 



Strongly Strongly 
Agree Disagree 

1. I feel that I understand the 5 4 3 2 1 
major purposes and goals of 

the program « 

2. I .now feel that I have an 5 4 3 2 1 
understanding of the basis of 

career development theory. 

3. It is important to make students 5 4 3 2 1 
aware of how basic skills relate 

to job performance. 

4. Career education concepts should 5 4 3 2 1 
be Infused into instruction in 

academic subjects. 

5. Career education concepts could 5 4 3 2 1 
be easily infused into my 

curriculum. 

6 . Career exploration should be 5 4 3 2 1 
organized around interest areas. 

7. The CPS is a good tool for helping 5 4 3 2 1 
students learn about jobs. 

8. I can see how the CPS will fit 5 4 3 2 1 
into my curriculum. 

9. The CPS will reinforce the basic 5 4 3 2 1 
skills that I teach. 

10. The staff development leaders 5 4 3 2 1 

conducted this session effectively. 
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Appendix C 
Sample Student Test 
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CONVENTION (Revised Edition) 
Student Test Booklet 



YOUR NAME 



YOUR TEACHER'S NAME 
YOUR CITY 



ERIC 
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Directions 

This is a test about different jobs people do. It is a test 
to find out what you know. And it is a test to find out how 
you feel about these jobs. 

Read each question carefully. Then read the different answers. 
Decide which answer is best. Then circle the letter next to 
that answer. 

Let's try one for practice. 



Which person works for the Post Office? 



Which answer is best? . . . Yes, Mail Carrier is the best 

answer. So, you would circle the letter "C" next to Mail Carrier. 

Now, start the test. Read and answer all of the questions. 



A. Firefighter 

B. Police Officer 




Mail Carrier 
Salesclerk 
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1. Which of the following occupations belongs to the field 
of PERSONAL SERVICES? 

A, flight attendant C. dry cleaner 

B. minister D. all of the above 

Which of the following are types o:^^ERSONAL SERVICES? 

Yes I don ' t know No 

2. services that take place 

in the home A B C 

3. hospitality services A B C 

4. spiritual guidance services A B C 

5. portering services A B C 

6. child care services A B C 

7. Which of the following is an appetizer? 

A. green beans C, chocolate cake 

B. fried chicken D. tomato -^uice 

8. Restaurants buy food from 

A. supermarkets C. farmers 

B. wholesale suppliers D. none of the above 

9. In what kind of restaurant ':1o customers serve themselves? 

A, table service C, cafeteria 

B. drive-in D. counter service 

10. Permanent customers would most likely be found in a 

A, commercial hotel C. residential hotel 

B. resort hotel D. motor hotel 

11. The laundry and dry cleaning service in a hotel is called 

A, valet service C. personal service 

B. maid service D. room service 

12. Together, which two industries are called the "hospitality 
industry"? 

A. hotel operation C. food service and 

and food service transportation 

B. recreation and D. transportation and 

hotel operation recreation 

13. Which worker is in charge of the linen room inventory? 

A. room clerk Co cashier 

B. maid D. housekeeper 
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14. Who must be good at doing arithmetic? 

A, auditor C. cook 

B. maid D, banquet manager 

15 • Who usually works in the sales department of a large hotel? 

A. housekeeper C. banquet manager 

B. cashier D. all of the above 

16 • Which worker carries baggage for hotel guests? 

A. maid C. headwaiter 

B. bellhop D. reservation clerk 

17. Which worker in a hotel/restaurant sits most of the time? 

A. telephone operator C. waiter 
room clerk D. cook 

18. Which hotel/restaurant job involves working outdoors 
the most ? 

A. doorkeeper C. maid 

B, chef D. cashier 

19. Which hotel/restaurant worker could be called at any 
hour of the day or night to do his or her job? 

A. electrician C. plumber 

B. house detective D. all of the above 

20. Which is an entry-level job in the hotel/restaurant 
industry? 

A. chef C. sales manager 

B. maid D. purchasing steward 

21. Which job in the hotel/restaurant industry requires the 
most education and/or experience? 

A. chef C. elevator operator 

B. auditor D. waitress 

22. Which affects the success of both a hotel doorkeeper 
and a banquet manager? 

A. management skills C. communications skills 

B. good math skills D. organization skills 

23. Which is an interpersonal skill needed by workers in 
PERSONAL SERVICES? 

A. ability to get along C. showing respect for 

with others others 

B, being friendly D. all of the above 
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24. 



25 



Room rates at a particular hotel 
are listed at the right. With 
these rates, what is the lowest 
charge six people would pay? 



A. 
B. 



$48 
$108 



C. $54 

D. $66 



Rates 

Twin 

Twin 

Double 

Double 

Double 

Suite 



T 

2 
2 
3 
4 
4 



person 

persons 

persons 

persons 

persons 

persons 



Suppose 80 dinner guests at a restaurant are expected 
to order shrimp. If four ounces of shrimp are used per 
serving, how many ounces of shrimp are needed? 

80 ounces 
320 ounces 



A. 
B. 



32 ounces 
160 ounces 



C. 
D. 



$18.00 
$22.00 
$24.00 
$28.00 
$32.00 
$50.00 



How would" you rate your knowledge of the WORK THAT IS DONE 
in each of these jobs? 







Very 
Good 


Good 


Average 


Poor 


Can 
Say 


26. 


Reservation Room Clerk 


A 


B 


C 


D 


E 


27. 


Cashier 


A 


B 


C 


D 


E 


28. 


Housekeeper 


A 


B 


C 


D 


E 


29. 


Maid 


A 


B 


c 


D 


E 


30. 


Chef 


A 


B 


c 


D 


E 


31. 


Cook 


A 


B 


c 


D 


E 


32. 


Waiter/Waitress 


A 


B 


c 


D 


E 


33. 


Banquet Manager 


A 


B 


c 


D 


E 



How would you rate your knowledge 


of the 


INTERESTS 


of workers 


in each of these jobs? 








Very 






Can 


Good 


Good 


Average 


Poor Say 


34. Reservation Room Clerk A 


B 


C 


D E 


35. Cashier A 


B 


C 


D E 


36. Housekeeper A 


B 


C 


D E 


37. Maid A 


B 


C 


D E 


38. Chef A 


B 


C 


D E 


39. Cook A 


B 


C 


D E 


40. Waiter/Waitress A 


B 


C 


D E 


41. Banquet Manager A 


B 


C 


D E 



How SATISFIED do you feel you 


would be 


working 


in each 


of 




these jobs? 












Very 




Somewhat 


Not 


Can 




Satisfied 


Satisfied 


Satisfied 


Satisfied 


Say 


42. Reservation Room Clerk 


A 


B 


C 


D 


E 


43. Cashier 


A 


B 


c 


D 


E 


44. Housekeeper 


A 


B 


c 


D 


E 


45. Maid 


A 


B 


c 


D 


E 


46. Chef 


A 


B 


c 


D 


E 


47. Cook 


A 


B 


c 


D 


E 


48. Waiter/Waitress 


A 


B 


c 


D 


E 


49. Banquet Manager 


A 


B 


c 


D 


E 
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50. Has this simulation helped you learn more about what 
workers do in their jobs ? 

A. Yes, very much 

B. Yes 

C. Yea, a little 
No 

E. I can't say 

51. Has this simulation helped you learn more about what 
different workers like and what they can do ? 

A. Yes, very much 

B. Yes 

C. Yes, a little 

D. No 

E. I can't say 

52. Has this simulation helped you learn about the jobs 
you like and the jobs you don't like ? 

A. Yes, very much 

B. Yes 

C. Yes, a little 

D. No 

E. I can't say 

53. Has this simulation helped you think about jobs you 
might choose ? 

A. Yes, very much 

B. Yes 

C. Yes, a little 

D. No 

E. I can't say 

54. Did you like this simulation? 

A. Yes, very much 

B. Yes 

C. Yes, a little 

D. No 

E. I can't say 

55. HOW hard were the jobs you did in this simulation? 

A. Too hard 

B. About right, most of the time 

C. About right, some of the time 

D. Too easy 

E. I can't say 
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56. Do you think this simulation is a good ^ay to learn about 
jobs ? 

A. Yes, for sure 

B. Yes 

C. Yes, maybe 

D. No 

E. I can't say 

57. Do you think that other students would like this simulation? 

A. Yes, for sure 

B. Yes 

C. Yes, maybe 

D. No 

E. I can't say 

58. Would you like to try another simulation that has different 
jobs? 

A. Yes, very much 

B. Yes 

C. Yes, maybe 

D. No 

E. I can't say 
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